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Periodic review sessions contribute to student learning across the 

disciplines in Pharmacology 

Orla P. Barry 1 , Eleanor O’ Sullivan 2 , and Marian McCarthy 3 

Abstract: Background: The teaching of the discipline of pharmacology is in 
constant flux. In order to meet the challenges of teaching pharmacology 
effectively we investigated a new teaching and learning strategy. Aim: Our aim 
was to investigate whether structured periodic review sessions (RS) could 
improve teaching and learning for students in a multidisciplinary undergraduate 
pharmacology module. Methods: Following each lecture students were asked to 
identify topics of difficulty in pharmacology using the one minute paper- 
classroom assessment technique (CAT). Three review sessions were then 
introduced based on the problematic issues identified by students. They completed 
a pre- and post-review session multiple choice question (MCQ) examination to 
gauge improvements in their learning. Feedback was obtained from students at 
the end of the module regarding the acceptability, advantages and limitations of 
the CATs and the review sessions. Results: There was active participation by 
students in all thirteen CATs (71.15% ± 1.2%), three review sessions (78.3% ± 

1.6%) and the end of module (EOM) questionnaire (81%). A significant increase 
in student learning across all disciplines was observed in all three review sessions 
(**, p<0.01; ***,p<0.001 and **, p<0.01 for review sessions 1-3 respectively). 

The majority of students (99%) expressed the opinion that the review sessions 
enhanced their learning of pharmacology. A limitation expressed by some 
students was the necessity to complete multiple CATs to support each of the three 
review sessions. Conclusion: Strategically structured student directed review 
sessions which are carefully designed and executed are an interesting and 
effective educational tool for improving and complementing student learning 
across the disciplines in pharmacology. 

Keywords: Review sessions, classroom assessment technique, undergraduate 
pharmacology, questionnaire, multidisciplinary. 

Introduction 

The teaching of pharmacology has progressed substantially in recent years from a passive 
traditional didactic lecture format to a more interactive inclusive student/teacher model (Rogers, 
2012; Sekhri, 2012; Zgheib et ah, 2010). Of note, however, the delivery of pharmacological 
information in a conventional lecture is still required prior to engaging with new teaching and 
learning strategies (Fry et al., 1999; Rogers, 2012). In this way students can understand and 
familiarise themselves with the topic(s) before re-addressing, re-enforcing and supplementing 
key principles using alternate strategies. In addition they are a fact of reality given growing 
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student numbers as well as financial pressures (Brown & Gamber, 2002). The error lies, 
however, when only didactic lectures are utilised which alone does not give the students the 
opportunity for deep learning (Bligh, 2000; Handelsman et ah, 2004; McKeachie et ah, 2006; 
Udovic et ah, 2002). 

The challenge to teach pharmacology effectively continues on a daily basis (Joshi & 
Trivedi, 2010). The direct consequence of increased drug discovery has led to a continuous 
increase in the associated scientific infonnation. Thus, it has become an almost impossible task 
to teach students all phannacological facts relating to individual drugs (Achike & Ogle, 2000). 
Only recently has significant consideration been given to the complexities of teaching and 
learning of phannacology. Novel teaching techniques are now in vogue aimed at promoting a 
more integrated and efficient programme as well as improving the quality of teaching in the 
discipline and in turn student learning. These include wet practicals where students apply their 
knowledge in a practical context in the laboratory (Rogers, 2012; Sekhri, 2012), computer 
assisted learning which provides a dry laboratory experience (Coleman et ah, 1995; Dewhurst 
and Norris, 2003), problem based learning (Gregson et ah, 2010), small group learning (Morgan, 
2003; Sekhri, 2012), team-based learning (Zgheib et ah, 2010), use of structured role play 
(Morgan, 2003), case studies (Routledge 1999; Rogers, 2012), collaborative online learning, 
(Wiecha, 2003), audio visual aids (Banerjee et ah, 2013), drug flash cards (Rogers, 2012) and 
electronic hospital libraries (Brewer & Hiscock, 2001). Despite such interventions, however, 
many students continue to find it difficult to master core knowledge in phannacology. They are 
often left memorizing unfamiliar tenns, drug names and pathways with a very limited frame of 
reference. 

To-date there is a paucity of studies investigating effective pharmacology teaching for 
multidisciplinary student learning within the same class (Darling-Hammond, 2008; Gardner & 
Boix Mansilla, 1994; Kwan, 2002). Different topics and methodologies have been reviewed for 
teaching phannacology to medical, dental, and nursing students (McBane & Mesaros, 2010). 
However, phannacological knowledge is essential not only for students who will be involved in 
clinical practice but also for those involved in the biological sciences (Kwan, 2002; Lymn & 
Mostyn, 2010). The composition of the class chosen for this research project consists of 
chemistry, biochemistry, physiology, medical and visiting Erasmus (European Union student 
exchange programme) students. The last group (Erasmus students) have traditionally been part of 
the cohort of the class taking this module. Their backgrounds are closely aligned with other 
student groups in the class. While pharmacology is strictly related to physiology (and 
pathology), the challenge in teaching this class is to define a core of knowledge in phannacology 
for each discipline according to the practice of each profession. Furthermore, the teaching of 
phannacology to medical students differs from that to science students as medical students not 
only have to master core concepts in pharmacology but must also be able to relate this 
information to the relevant management of the underlying disease. 

The purpose of this study was to explore a new teaching and learning strategy in 
phannacology for students from multidisciplinary backgrounds. Previously the module consisted 
of didactic lectures with three associated laboratory practicals. We have now replaced some 
lectures with periodic RS which complement the traditional instructive lectures. Importantly, the 
teaching in the RS did not occur at the expense of students acquiring a lesser amount of essential 
knowledge in the lectures. The RS were designed to focus and highlight relevant 
phannacological material for each discipline without providing excessive information. Individual 
student conducted CATs guided the design and activities of the RS. CATs are fonnative 
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evaluation methods whose main aims are to pennit assessment of student understanding and 
learning and to allow for timely feedback about the effectiveness of particular teaching 
techniques. Approximately fifty different CATs have been described to-date (Angelo, 1991a,b; 
1998; Angelo & Cross, 1993; Byon, 2005; Rouseff-Baker & Holm, 2004) with limited 
qualitative and quantitative research assessing their value in improving student learning (Cottell 
& Harwood, 1998; Simpson-Beck, 2011). Some CATs access student prior knowledge, recall 
and understanding (minute paper, muddiest point, background knowledge probe and memory 
matrix), while others assess student’s skill set in analysis and critical thinking (pro-and-con grid, 
categorizing grid, defining features matrix and content, form and function outlines). 
Furthermore, CATs permit assessment of students’ skills in synthesis and creative thinking 
(concept maps), problem solving (problem recognition tasks), application and performance 
(application cards) and student self-awareness as learners (autobiographical sketches). Although 
the various CATs differ in their complexity and the time necessary for their preparation, 
administration and final analysis, they can all be utilised to improve course content, teaching 
methodologies and ultimately student learning. It is important to be aware, however, that 
irrespective of the CAT employed as with all educational interventions, due consideration must 
be given to the different learning styles of the students from the different disciplines. The 
approach taken in our CATs and the RS may not appeal to each and every student given different 
learning preferences (Gardner, 1995, 1999). Thus, in an effort to accommodate different learning 
strategies we incorporated different strategies into our RS including visual and auditory 
techniques. In brief, we observed that the RS aided students’ learning and deepened their 
understanding in pharmacology. They permitted students to evaluate, synthesise and apply their 
knowledge of phannacology more readily (Bloom, 1956; Cronin Jones, 2003; Ebert-May et al, 
1997; Litke, 1995). Thus, periodic RS are an interesting and cost-effective tool worth exploring 
for effective teaching and learning to a disparate group of undergraduate students studying 
phannacology. 


Method 


Participants 

Research was conducted with an undergraduate phannacology class of eighty nine 
students, forty eight of whom were male (54%). Students were from four different disciplines i.e. 
chemistry, biochemistry, physiology, medicine as well as visiting Erasmus students. All students 
had completed at least one pharmacology module prior to enrolling in this module 
(PT2101/PT3005). The module was taught in three distinct sections namely (i) inflammation and 
anti-inflammatory drugs, (ii) antimicrobial chemotherapy and (iii) cancer chemotherapy. 
Students were delivered didactic lectures (as was traditionally done within this module) but also 
engaged in CAT, MCQs and RS which were newly introduced for our research purposes. 

Design, conducting and analysis of student CATs 

(i) Design : Students were asked to complete a one minute paper (Angelo & Cross, 1993) 
at the end of each lecture stating (i) two pharmacological aspects that they understood well in the 
lecture and (ii) two pharmacological aspects that they found difficult to understand in the lecture. 
Topics listed in the latter question provided the basis for the RS. (ii) Conducting : At the end of 
each fifty minute didactic lecture students were given sufficient time to complete a CAT (this 
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normally takes longer than one minute so students can process the lecture material and provide a 
response (Stead, 2012)). CATs are an invaluable learning tool not only for students but for the 
teacher as well. The advantages and disadvantages of the one minute paper have recently been 
reviewed (Stead, 2012), (hi) Analysis: CATs from all participating students were carefully read 
to ascertain the areas of student difficulties as well as ease in the preceding lecture. CATs were 
pooled from the first four lectures for RS1, the next four lectures for RS2 and the remaining five 
lectures for RS3. Topics of difficulty were entered into an excel sheet and fonned the basis for 
each of the three subsequent RS. Each RS was based on six pharmacological topics most 
frequently identified as difficult by students. 

Description of the three Review Sessions 

RSI and RS2 were conducted after a block of four lectures each covering inflammation 
and antimicrobial chemotherapy respectively. RS3 occurred following the remaining five 
lectures in the module covering cancer chemotherapy. 

Design and conducting of Review Sessions including MCQ examinations 

(i) Review topics: Six topics of difficulty identified most frequently by students fonned 
the basis of the material to be re-addressed in the RS as well as the pre- and post-review MCQ 
questions. A single MCQ topic was assigned to each of the six problematic areas with five 
different questions of fonnat T/F/D (true/false/don’t know) associated with the topic, (ii) Format 
of the RS: Students completed the MCQ questions (6 topics x 5 T/F/D MCQ questions =30 
questions in total) in the first fifteen minutes. The next thirty minutes was devoted to revisiting 
the six problematic areas identified by students in their CATs. The review time was used to 
reinforce the important and fundamental aspects of the six different pharmacological topics using 
an interactive teacher/student powerpoint presentation. The remaining fifteen minutes was 
allocated to the students re-sitting the same MCQ questions presented in the pre-review MCQ. 
Both pre- and post-review MCQs were printed on different colored paper and stapled together to 
allow analysis of student learning from individual students, while maintaining student 
anonymity. All MCQs were conducted anonymously except through identification of student 
discipline. 

Strategies to design the Review Sessions and MCQs 

Key challenges in designing and conducting the RS (as well as teaching the module in 
general) was to keep to the forefront the knowledge that the student group was diverse and from 
different disciplines. Thus, different criteria were adhered to in designing the MCQ examination 
questions (which did not differ in the pre- and post-review MCQ examination) as well as how the 
material identified by students was to be re-visited during the RS. Four different strategies were 
employed: (i) relevant; questions were designed and material was reviewed at an appropriate 
level to reflect the backgrounds, needs and diversity of students. All material was closely aligned 
with learning outcomes of the module; (ii) realistic; the level of phannacology that the students 
required at this point in their training was taken into account (iii) engaging; both MCQ questions 
and material reviewed incorporated a mix of straight forward knowledge based enquiry as well 
as more challenging aspects of pharmacology (Bloom’s Taxonomy, 1956) and (iv) instructional; 
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the questions and material readdressed helped to inform and assess students’ core and applied 
phannacological knowledge. 

Analysis of pre- and post-review MCQ results 

Each participating student (identified by discipline only) submitted a pre- and post¬ 
review MCQ sheet for analysis, totalling sixty answers per student per RS. The correct answers 
to the thirty MCQ questions were firstly entered into an excel sheet, followed by student T/F/D 
answers to the pre- and post-review MCQs. A plus one value was assigned to each correct 
answer and a zero value to an incorrect answer or an unanswered question. Both the pre- and 
post-review MCQ results were analysed for each student. Lastly, the change in each student 
answer for all thirty MCQ questions was calculated between the pre- and post-review answers as 
follows; a value of zero was assigned to no change to a correct or incorrect answer, plus one for 
an incorrect to a correct answer and minus one for a correct to an incorrect answer. 

Questionnaire 

The written questionnaire is a powerful tool in research (Oppenheim, 1992, Wellington, 
2000). An EOM questionnaire was designed to assess student feedback on teaching, learning and 
assessment methods in the RS. Students from all five disciplines completed the questionnaire in 
the last fifteen minutes of a two hour tutorial. The first half of the questionnaire consisted of 
seven statements with students indicating whether they strongly agreed (SA), agreed (A), neutral 
(N), disagreed (D) or strongly disagreed (SA) with each of the statements. This part of the 
questionnaire was designed to determine quantitative data on student views of the RS as an 
unorthodox teaching, learning and assessment tool. The second half of the questionnaire invited 
qualitative comments from students on their experiences of the RS in an effort to identify 
advantages and disadvantages of this novel technique. Similar to the student CATs and pre- and 
post-review MCQ submission, the questionnaire was anonymous except for identification of the 
student discipline. 

Statistical Analysis 

Results are expressed as mean±S.E. Statistical comparisons were made by using 
analysis of variance with subsequent application of Student's t test, as appropriate. GraphPad 
InStat 3 software was used for statistical analysis also. 

Ethical approval 

All students provided their signature at the commencement of the module indicating their 
willingness to participate in the different teaching, learning and assessment aspects of the RS. 
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Results 


CAT participation and analysis 

All students present actively participated in the CATs following each lecture. Mean total 
class participation for all thirteen CATs was 71.15% ± 1.2%. Interestingly there was no 
statistically significant difference in student attendance and participation (there was 100% 
correlation) in all thirteen CATs despite frequent EOM examinations in other subjects towards 
the end of the teaching period (data not shown). 

The most frequently identified areas of difficulty outlined by students in their CATs can 
be summarized as follows; (i) new tenninology, (ii) cellular pathways, (iii) drug 
pharmacodynamics i.e. the mechanism of action of drugs, (iv) drug inducers and inhibitors, (v) 
cell cycle control and (vi) multi-drug resistance. More specifically students outlined their 
misunderstandings and knowledge gaps relating to pro- and anti-inflammatory pathways 
including the arachidonic acid pathway, the peroxisome proliferator-activated receptor and the 
hypothalamic pituitary adrenal axis (Table 1). Clarification of drug phannacodynamics was 
outlined in student CATs across all thirteen lectures (Table 1). A gap in their knowledge 
regarding drug inducers and inhibitors related to the pharmacology of the cytochrome P450 
family of microsomal enzymes (Table 1). Students also requested revision of cell cycle control in 
the context of cancer proliferation and apoptosis, anti-microbial resistance and anti-cancer multi¬ 
drug resistance (Table 1). 

The CATs aided teaching as well as student learning as the module progressed. Students 
expressed (in their EOM questionnaire) that they paid significantly more attention and 
concentrated for a longer period of time (more than the average twenty minutes, McBane & 
Mesaros, 2010) in the lectures in order to be able to complete the CATs. As each CAT was 
performed following a single lecture they provided an opportunity to access the standard of 
teaching and student learning in real time. Timely analysis of the CATs offered a window of 
opportunity to correct some teaching aspects which may have required adjustments prior to the 
subsequent lecture. 

Review session teaching and student learning 

The purpose of the RS (designed and conducted as outlined in Methods) was to 
complement the teaching in the lectures and to aid student learning. A significant proportion of 
the class attended and participated in each review session (78.8%, 80.9% and 75.3% for RSI, 2 
and 3 respectively). The highest participation in all three RS was seen in the medical student 
group with a mean value of 86.7% ± 2.7%, the lowest observed in the physiology student group 
with 65.10 ± 1.6%. This is an interesting observation as the module is an elective special study 
module for medical students but a compulsory module for physiology students. 

Teaching: In RSI students were taught how to distil down the various pathways into their 
associated elements focusing on the sites that are specifically targeted with clinically available 
drugs. Teaching was initially centered on pathway umbrella tenns with more specific terms 
being introduced afterwards (Table 2). Teaching (partly in RSI) and mainly in RS2 focused on 
drug classes rather than on multiple individual drugs. A key difficulty in teaching phannacology 
is dealing with the sheer volume of drugs that are clinically available. Students find it extremely 
difficult to remember drug names, associate each drug with a particular drug class and to 
memorize and retain the phannacological components of each 
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Table 1 


Student CAT analysis 


Lecture 

number 

Analysis of student CATs 

Six main areas of student difficulty 

1-4 

Pro- and anti-inflammatory pathways 

(i) AA, (ii) PPAR, (iii) HP A 


Cox-2 specific inhibitors 

(iv) Mechanisms of drug specificity 


Paracetamol 

(v) Mechanism of drug poisoning and treatment 


Glucocorticoids 

(vi) Mechanisms of action 

5-8 

Antibiotics 

(i) (3-lactam cell wall synthesis inhibitors 


Drug inducers and inhibitors 

(ii) Cytochrome P450 family 


Folate as a pharmacological tool 

(iii) Folate synthesis, metabolism and utilisation 


Anti-virals 

(iv) Mechanism of action of acyclovir 


Antifungals 

(v) Mechanism of action of flucytosine 


Anti-malarials 

(vi) Mechanisms of anti-malarial drug resistance 

9-12 

Cancer genetics 

(i) Prot-oncogenes versus oncogenes 


Anticancer drugs 

Mechanisms of action of (ii) topoisomerase 
inhibitors, (iii) aromatase inhibitors, (iv) EDGF 
inhibitors 


Cancer proliferation and apoptosis 

(v) Cell cycle control 


Drug resistance 

(vi) Cancer multi-drug resistan 


All CATs were a one minute paper completed by students at the end of each lecture. Six main 
areas of studen t difficulties were iden tified from lectures 1-4 for RS 1, lectures 5-8 for RS2 and 
lectures 9-13 for RS 3. AA; arachidonic acid, PPAR; peroxisome proliferator-activated 
receptors, HP A; hypothalamic pituitary axis. 

individual drug. Thus, we employed a teaching technique using prototypical drugs i.e. a standard 
or typical drug which is a lead agent in a drug class (family). These are common agents used in 
exam questions. Knowledge of essential pharmacological principles of prototype drugs will later 
pennit students to apply this knowledge instantaneously to similar drugs within the same drug 
class. Anned with core infonnation using the prototype approach provides an adequate learning 
basis and knowledge store for both non-clinical and clinical years ahead. Thus, teaching in RS2 
focused on drug classes using prototypical drugs rather than individual drugs. Key drug 
information (using the prototype drug) including name, how it works and major side effects were 
taught. Application of core knowledge was reinforced as opposed to the expectation that students 
should simply memorize vast volumes of drug data (Table 2). Also in RS2 students were taught 
to recognize potential drug-drug interactions using the cytochrome P450 (Cyt P450) family of 
liver microsomal enzymes as examples (Table 2). Drug classes were identifying as either 
substrates, inducers or inhibitors of Cyt P450 members initially. Individual drugs falling outside 
these three categories were outlined. Finally in RS3 anti-cancer drug pharmacology was 
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reinforced by dividing drug classes into older non-targeted drugs versus newer specific targeted 
drugs. Commonly observed side-effects depending on whether the drug was a new or old 
chemical was highlighted to students. Again teaching in the RS complemented rather added to 
the material delivered in the lectures. Targeted review of student focused topics allowed for 
phannacology to be revised in a cohesive, clear and concise manner. Reinforcement and in some 
instances repetition of some phannacological topics helped deepen student understanding. 

Table 2 


Teaching and learning in the three review sessions 


Review session 
number 

Teaching 

Student learning 

1 

Inflammatory pathway(s) steps and 

(i) Umbrella terms 


terminology 

(ii) Specific terms 

2 

Key aspects of drug classes 

(i) Pharmacology of drug classes using 
prototype drugs 

(ii) Apply knowledge to clinically relevant 
drugs 


Drug-drug interactions 

(iii) Typical drug combinations 

3 

Cancer 

(i) Cell cycle control 

(ii) Anti-cancer drugs old versus new 

(iii) Side effects 

(iv) Multi-drug resistance 


Teaching is student driven based on the various CATs. Teaching emphasis is placed on key 
pharmacological aspects. Students learn core knowledge initially followed by its application to 
applied pharmacology. 


Learning: The focus of the RS was to aid student learning by giving students the 
opportunity to revise pharmacological material a few days after the original lecture material was 
delivered when information and knowledge was still recent. This offered the students an 
opportunity to correct any misconceptions in a timely manner. The student/teacher interactive 
style used for the RS, as opposed to a teacher led didactic lecture aided student learning. Students 
learned to focus initially on pathway umbrella terms and then to concentrate on specific terms 
(Table 2). They saw the importance of learning phannacology using the drug class prototype 
model initially in order to be able to apply their knowledge afterwards to specific drugs (Table 
2). Students also learned how to identify important drug-drug interactions, learned how cancer 
arises and how drugs can tackle this global health issue (Table 2). 

It was extremely important during the RS to keep to the forefront the knowledge based 
requirements of the different student cohorts from various disciplines. Thus, careful strategic 
planning of the teaching of pharmacological drug aspects was necessary for it to be applicable to 
chemistry, biochemistry, physiology, medical and visiting Erasmus students. The teaching topics 
utilized during the RS are outlined in Table 3. These included teaching students the importance 
of chemical structures in predicting structure/activity relationships and how to interpret 
phannacological data in terms of drug-target pharmacodynamics (chemistry students), 
application of biochemical pathways and molecular pharmacology to understanding how drugs 
work (biochemistry students), the close association between physiology/pathophysiology and 
phannacology and how some common drugs relate to these processes (physiology students), 
clinical application of basic pharmacology and how the mechanisms of drug actions relate to the 
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management of specific diseases (medical students) and focusing on core pharmacological 
aspects (Erasmus students). The structured RS permitted more discipline driven teaching of 
phannacology that was not always possible in the lectures. This was mainly driven by the fact 
that more time could be devoted to individual discipline related topics. Topics requiring further 
revision or clarification were clearly outlined by students’ CATs and so could be specifically 
targeted to individual disciplines. Also, a higher level of student/teacher interactive discussion 
created an environment of a questions and answer session specifically targeted to individual 
student disciplines and requirements. 

Table 3 


Teaching strategies employed per discipline in each of the three review sessions 


Individual disciplines 

Topics to improve student learning 

Chemistry 

Structure/activity relationships 

Biochemistry 

Biochemical and molecular emphasis 

Physiology 

Physiological and pathophysiological emphasis 

Medicine 

Clinical emphasis using real-world clinical situations 

Erasmus 

General pharmacology 


Teaching in each of the three RS was tailored where possible to each of the five different student 
disciplines in the class. 


MCQ examination 

The objectives of the three MCQ examinations were to test students’ core as well as 
applied knowledge in (i) inflammation, (ii) anti-microbials and (iii) cancer. Analysis of 
individual student pre- and post-RS MCQs readily indicated whether or not there was an 
improvement in student learning. There was a significant increase in mean MCQ results between 
the pre- and post-RS MCQ examinations for each of the three RS (Figure 1). Greatest 
improvement in overall student perfonnances was observed in RS2 (p***< 0.001) with similar 
values observed in RSI (p**< 0.01) and RS3 (p**< 0.01). A similar significant increase in 
student learning was observed for all five disciplines in RSI-3 (data not shown). 

On closer analysis of the data, it was interesting to observe that there was a significant 
improvement in student learning in all areas reviewed in the three RS i.e. cellular pathways, 
phannacodynamics (PD), cancer and multi-drug resistance (Figure 2). In fact, the data permitted 
identification of individual questions and thus phannacological topics that students from the 
different disciplines demonstrated the largest as well as the smallest improvement in learning 
(data not shown). For instance understanding of pro- and anti-inflammatory pathways (in RSI, in 
particular peroxisome proliferator-activated receptors pathway) and their overall 
phannacological regulation remained challenging for the physiology cohort within the class. This 
was not evident in the biochemistry group of students for example. This may be explained by the 
fact that biochemistry students may have a stronger background in a range of biological and 
biochemical pathways (within the human body) taught in different modules within their 
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discipline. Moreover, the physiology group of students found understanding the genesis of 
cancer and its pharmacological control more difficult than all other groups. While 



Figure 1. Students increase their mean MCQ examination results following review sessions. 

Mean class MCQ examination results in pre- and post-review MCQs carried out in review 
sessions 1-3. The results shown are mean ± S.E. of the entire class performance. Significant (**, 
p<0.01; ***,p<0.001) changes from pre-review MCQ results. 


300 


200 - 

Mean correct 
MCQ answers 

100 


0 

Figure 2. Students demonstrate improved learning in different pharmacological topics. The 

mean correct MCQ examination results in pre- and post-review MCQs for the entire class are 
shown for five independent pharmacological topics. The results shown are mean ± S.E. of the 
entire class performance. Significant (*, p<0.05; **, p<0.01; ***,p<0.001) changes from pre¬ 
review MCQ results. PD; pharmacodynamics. 

analysis of the pre- and post-MCQs demonstrated a significant increase in their understanding in 
this topic the MCQ mean results for the physiology group were significantly lower (p**< 0.01) 
than all other groups. It was also interesting to observe that all groups except the visiting 



Journal of the Scholarship of Teaching and Learning, Vol. 15, No. 1, February 2015. 
josotl .indiana .edu 


47 































Barry, O.P., O'Sullivan, E., & McCarthy, M. 


Erasmus student group demonstrated a significant increase in their understanding of drug 
phannacodyamics across a range of drug classes in all three RS (data not shown). This was not 
evident in the Erasmus group as they performed particularly well in this area of pharmacology in 
both their pre- and post-review MCQ examinations. This may be related to the fact that 80% of 
the visiting Erasmus student group was undertaking a pharmacy degree in their home country 
whereupon they may have previously undertaken a pharmacology module covering the 
phannacodymanics of commonly used drugs. Lastly, of note it was the area of drug resistance in 
particular that proved most difficult for all student groups as evident from the lower mean correct 
MCQ answers in both the pre- and post-review MCQ (Figure 2). This was somewhat surprising 
as students are taught that in general drug resistance is related to drug phannacodymanics. Once 
knowledge and understanding of a drug’s mechanism of action is obtained, then by inference, so 
too is the mode of resistance associated with that drug. Overall, however, it was encouraging to 
see that there was a significant improvement in student learning in terms of core as well as 
applied pharmacological knowledge in all three RS (Figure 3). 

Similar to the RS, the MCQ examinations provided a teaching and learning opportunity. 
In terms of teaching, there was an opportunity to ask students multiple targeted questions which 
is not possible in a traditional lecture. It also allowed for timely assessment of students’ 
knowledge and understanding. From the student perspective the MCQs helped focus students’ 
attention throughout the RS. They helped connect topics together which were specifically 
outlined by the students themselves and not the teacher. The MCQs provided opportunities for 
student self-assessment, a chance for the students to practice dealing with typical MCQs prior to 
the EOM MCQ examination and demonstrated to them the level of core and applied knowledge 
that was required in different phannacological areas. Overall the MCQs enhanced student 
engagement and specifically guided student test taking logic. 

Questionnaire 

To investigate the effects of the various strategies used in this study student feedback was 
obtained using a written questionnaire covering various aspects of teaching, learning and 
assessment methods. Active participation was evident in all student disciplines (chemistry 
(95%), biochemistry (100%), physiology (57%), medicine (84%) and Erasmus (67%)). Of note 
least participation occurred in the physiology group which was previously observed in the RS 
(65.10 ± 1.6%). The first half of the questionnaire provided frequency rates for each statement in 
the survey. Frequencies were analysed per discipline (data not shown) as well as per total class 
student group (Table 4). Ninety three percent of the class “strongly agreed” and “agreed” with 
the first statement. In support of this statement one student commented (in the second half of the 
questionnaire) that “/ concentrated more in the lectures knowing that I had to complete a CAT at 
the end outlining areas I understood well and areas of misunderstanding'" . The next statement 
“CATs became monotonous after a while'" revealed the largest variation in student responses 
(Table 4). Interestingly, the medicine group (67%) provided the highest “strongly agreed” and 
“agreed” responses with this statement. In contrast all other disciplines demonstrated lower 
percentages (chemistry: 28%, biochemistry: 41%, physiology: 58% and Erasmus: 25%) (data not 
shown). The positive response from students for the next two statements (100% and 94% for 
statements 3 and 4 respectively) clearly indicated that the RS provided students with the 
opportunity to review lecture material which was directly focused on topics that students found 
difficult. Careful planning of the RS and associated MCQ examination questions proved fruitful 
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as 94% of respondents indicated that the RS were closely aligned with topics students found 
difficult while 92% indicated that the MCQ questions were at an appropriate level (statement 5, 
Table 4). Ninety percent of students welcomed active participation in their own assessment as a 
means to improving their overall leaning and understanding (statement 6, Table 4). Finally the 
majority of respondents (99%) agreed that the RS enhanced their learning outlining the positive 
response of students to the RS as a tool for learning (Table 4). 


Review session 1 Review session 2 Review session 3 



Core Applied Core Applied Core Applied 

Knowledge Knowledge Knowledge Knowledge Knowledge Knowledge 


Figure 3. Students demonstrate improved learning in core as well as applied knowledge in 
pharmacology. The mean correct MCQ examination results in pre- and post-review MCQs for 
the entire class in review sessions 1-3. Results are shown for core as well as applied knowledge 
in each of the review sessions. The results shown are mean ± S.E. of entire class performance. 
Significant (*, p<0.05; **, p<0.01; ***,p<0.001) changes from pre-review MCQ results. 

On a personal level, the second half of the questionnaire provided important student 
responses indicating the positive and negative aspects of the RS as a novel teaching, learning and 
assessment technique. Analysis of the qualitative student feedback allowed for eight distinct 
categories to be devised. The positive aspects of the RS can be summarised as follows; (i) they 
assisted student understanding (90%), (ii) they allowed for student self-assessment questions 
(82%), (vi) they were conducted in a positive relaxed atmosphere (23%), (vii) the topics covered 
were concise and student focused (86%) and finally (viii) they provided structure to the 
pharmacological topics covered in the module (31%). 

Similarly, the negative student responses regarding the RS can be summarised into 
another eight distinct categories; (i) more time should be devoted to the RS (27%), (ii) the 
absence of appropriate student feedback in terms of providing correct MCQ answers as well as 
individual student performances (6%), (iii) the type of RS with the associated MCQ type 
examination as opposed to essay style or laboratory specific examinations (2%), (iv) monotony 
of the CATs (47%), (v) class size of the RS i.e the entire class instead of smaller individual 
groupings (4%), (vi) use of similar lecture slides in the RS vs didactic lectures (35%), (vii) large 
number of drug names (14%) and finally (viii) omission of topics identified as difficult in the RS 
(6%). It is important to note that while eight separate headings could be assigned to both the 
positive and negative student responses they were not equally weighted. While some of the 
negative responses can be readily addressed, others, however, are directly related to resource 
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issues which are more difficult to tackle and could continue to have considerable controlling or 
restrictive implications. However, it was apparent that the extent of positivity highlighted with 
respect to the use of RS as a non-traditional teaching, learning and assessment method clearly 
overwhelmingly dominated the overall findings of the student questionnaire. 

Table 4 


Student responses to review session questionnaire statements 


N=72 (81% of the entire class) 







SA 

A 

N 

D 

SD 

The CATs were useful to outline difficult as well as easy topics 

37 

30 

4 

1 

0 

CATs became monotonous after a while 

4 

30 

22 

13 

3 

The review sessions were a good way of reviewing lecture material 

68 

4 

0 

0 

0 

The review sessions were targeted to topics students found difficult 

57 

11 

4 

0 

0 

The MCQs in the pre- and post-review sessions were at an appropriate 
level 

33 

33 

5 

1 

0 

Participation in your own assessment i.e. student CATs followed by 
review sessions helped your learning and increased your understanding 

32 

33 

7 

0 

0 

The review sessions in general enhanced your learning 

53 

18 

1 

0 

0 


Questionnaires were completed in-class in a relaxed and non-timed fashion. Students were 
asked to give their opinion on seven different statements by answering SA; strongly agree, A; 
agree, N; neutral; D; disagree, SD; strongly disagree. 

Discussion 

Pharmacology has long been recognized as a formal discipline in scientific medicine 
(Flexner, 1910). While there it holds its rightful place, it also seamlessly integrates into many 
interdisciplinary areas of basic and clinical sciences. In light of this fact it is not unusual to 
discover a number of distinct student groups from different disciplines in the one phannacology 
class. For this particular study one of the key features that influenced the class choice was its 
multidisciplinary nature. While the module used in this study like all others in the discipline aims 
to teach the undergraduate student the principles of pharmacology along with the process of 
phannacologic reasoning, the key goal of the intervention was to improve teaching and learning 
for multidisciplinary students. Chemistry students were taught to appreciate the structural 
diversity of pharmacological drugs, their chemical characteristics and applications. The 
biochemistry students were taught how drugs regulate various metabolic pathways and how 
important sequence data is to drug function. The physiology students were taught how drugs 
relate to physiological and pathophysiological processes in the human body and lastly, the 
medical students were taught the pharmacological management of selected major diseases. In 
contrast to the lectures the RS were student designed and targeted which encouraged more 
interactive student and teacher engagement. They were employed to continually engage students 
while keeping the information succinct and focusing on essential principles necessary for each 
discipline. 
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One of the important findings of this study is that, despite the differences in student 
disciplines and backgrounds they succeeded in using the RS to their advantage and improving 
their understanding and knowledge of both core and applied phannacological concepts. Student 
performances significantly improved following participation in the RS as evident from analysis 
of pre- versus post-review MCQ examination results for each individual student. This 
enhancement was both discipline- as well as topic-independent as each of the RS readdressed 
different areas of specialisation in pharmacology. However, overall mean correct MCQ 
examination results did vary somewhat between the various groups in all three RS. This is not 
surprising given the diverse pharmacological topics and concepts covered and examined in this 
module and the associated diversity of the five distinct student groups. In addition the vertical 
and horizontal integration of the different curricula within each discipline adds another layer of 
diversity within individual groups. Overall vigilant preparation of appropriate MCQ examination 
questions as well as how topics were strategically re-addressed was extremely important. While 
this was somewhat challenging proper design and implementation of the RS was essential for 
them to be utilised as an effective teaching, learning and assessment tool. 

Student feedback demonstrated that the RS were appreciated as a welcome change to 
traditional didactic lectures as outlined by the following two student responses “/ consider the RS 
and their associated MCQ examinations very useful compared with endless lectures to better 
understand pharmacology ” and “/ really enjoyed the RS, an unusual change from regular 
lectures ”. They helped cement and reinforce essential topics in pharmacology in a relaxed and 
motivating environment conducive to learning. Student feedback provided important insight into 
the future design improvement of the RS. It is very encouraging that students suggested that the 
use of this technique would be beneficial in other modules both in related and unrelated 
disciplines. It was gratifying to observe the high level of attendance and engagement by students 
in all steps of the RS despite the absence of attainable marks which so often provides the only 
incentive for students’ participation (Markham et al., 1998). 

It is extremely important that recognition and appreciation of effective non-traditional 
teaching methods in phannacology come from colleagues, students and institutions (Markham et 
al., 1998; Desai, 2009; Joshi & Trivedi, 2010). Teachers of pharmacology are aware of non- 
traditional methods in teaching the discipline but lack of student and collegial motivation, lack of 
recognition by institutes, shortage of resources and the overall time involved in these processes 
lead some teachers to conclude that perhaps these alternative methods of teaching are a waste of 
time (Markham et al., 1998; Desai, 2009; Joshi & Trivedi, 2010). More worryingly, a higher 
value can often times be accorded to conducting pharmacology research and consultancy 
activities rather than implementing and promoting effective teaching of pharmacology by 
focusing on teaching, learning and assessment. Thus, it is timely to not only seriously address the 
significance and value of researching teaching in phannacology but to re-enforce its importance 
and equitable place in contributing to the effective functioning of the discipline. 

In summation, we can conclude that RS are a successful and novel sole-instructor 
teaching and learning tool in pharmacology engaging large numbers of students from 
multidisciplinary backgrounds. This conclusion is based on comparing student performances, 
EOM student evaluations of the RS and student satisfaction with what they have learned and 
accomplished in the module. The success of our intervention is somewhat multifaceted. It lies in 
the active student participation in all elements of the RS which may be partially aligned to their 
novelty. The student-directed topics meant that the RS strategically focused on pharmacological 
elements directly related to each student discipline and thus readily pertinent. Overall the 
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teaching and learning was different to didactic lectures in tenns of being focused, relevant, 
interactive and relaxed. Some challenges along the way, however, cannot be ignored. Some 
students thought the CATs became monotonous after a period of time. The many hours devoted 
to the various steps associated with the RS: (i) analyzing each individual student CAT from 
multiple lectures, (ii) the design of the review topics, (iii) the design of appropriate MCQ 
examination questions, (iv) analyzing each individual student pre- and post-review MCQ 
examination results in each of the three RS and (v) interpretation of the resultant data. There is 
the omission of topics from the RS proffered by individuals but which could not be addressed 
due to time constraints. Finally, as outlined previously a significant proportion of the class 
completed the various CATs, attended each of the three RS and completed the EOM 
questionnaire. It must be noted, however, that 100% student attendance was never achieved in 
any of the outlined activities. In addition there was variation in the numbers of students attending 
from the different disciplines. 

Despite the limitations outlined above it is our hope that this study will be a starting point 
for continuous experimentation and optimization of the use of novel periodic RS in the teaching 
of pharmacology to undergraduate students. In fact armed with the knowledge of our research 
limitations we are presently implementing an amended version of the research outlined in this 
report. One way of overcoming the limitation of not reaching full student attendance and 
participation is to reward students and have it aligned with their overall continuous assessment 
(CA). Thus, for each RS attended and post-review MCQ completed students are currently 
awarded a mark that is carried forward as part of their module overall CA. As a result of this new 
intervention we have now achieved 100% student attendance and participation. Another change 
currently being imposed is the extension of the RS to an hour and a half to encompass more 
topics outlined by individual students. It is our desire that other limitations will continue to be 
ironed out with future implementation of our research activities. 

Lastly, the flexibility of our RS model will permit prospective researchers to not only 
replicate our process but importantly tailor it to their own needs and specifications. Our current 
approach may be modified and subsequently maintained through varying the one minute paper 
format and/or timing (Simpson-Beck, 2011; Stead, 2012) as well as the number of CATs utilised, 
completing CATs per student discipline group as opposed to individual student feedback, 
reducing the number of RS if necessary and implementing a more automated system for analysis 
of student feedback in general where appropriate. Thus, awareness of the associated limitations 
of the existing RS model and some potential ways of overcoming them will assist further in the 
effective implementation of our research activities. In addition future research should not only 
further test but also extend our findings to go beyond the student disciplines we have outlined in 
this study. Importantly our research activities were positively linked with increased teacher job 
satisfaction and teachers’ self-efficacy (data not shown). This is despite the increased workload 
associated with our research activities (which may be reduced in the future) and the possibility of 
lack of recognition for accomplishments (Greenglass & Burke, 2003; Klassen et ah, 2010). 
However, the positive engagement by a high percentage of the students in all aspects of the RS, 
good teacher-pupil rapport and overall success in improving student learning were directly linked 
to achieving high levels of personal satisfaction from the process. These are important findings 
as overall job satisfaction can in turn influence students’ motivation and achievement (Klassen et 
ah, 2010; Skaalvik & Skaalvik, 2007). Our study clearly holds implications for improving 
teaching and student learning. Implementing our existing activities or an abridged adaptation in 
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future studies might provide more nuanced understandings of its effectiveness beyond the 
discipline of phannacology. 
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